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Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )Q Responsive to communication(s) filed on . 

2a)Q This action is FINAL. 2b)S This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) S Claim(s) 1-20 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) KI Claim(s) 1-11,14.15,17 and 19 is/are rejected. 

7) [x] Claim(s) 12.13,16,18 and 20 is/are objected to. 

8) Q Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)[3 The drawing(s) filed on 16 November 2001 is/are: a)Q accepted or b)S objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
1 1 )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-1 52. 

Priority under 35 U.S.C. § 119 

12)Q Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2.D Certified copies of the priority documents have been received in Application No. _. 

3-D Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 
Drawings 

1 . Figures 1 A and IB should be designated by a legend such as -Prior Art— because only 
that which is old is illustrated. See MPEP § 608.02(g). Corrected drawings in compliance with 
37 CFR 1.121(d) are required in reply to the Office action to avoid abandonment of the 
application. The replacement sheet(s) should be labeled "Replacement Sheet" in the page header 
(as per 37 CFR 1.121(d)) so as not to obstruct any portion of the drawing figures. If the changes 
are not accepted by the examiner, the applicant will be notified and informed of any required 
corrective action in the next Office action. The objection to the drawings will not be held in 
abeyance. 



Claim Objections 

2. The following sections of 37 CFR §1 .75(a) and (d)(1) are the basis of the following 
objection: 



(a) The specification must conclude with a claim particularly pointing out 
and distinctly claiming the subject matter which the applicant regards as his 
invention or discovery. 

(d)(1) The claim or claims must conform to the invention as set forth in 
the remainder of the specification and the terms and phrases used in the 
claims must find clear support or antecedent basis in the description so 
that the meaning of the terms in the claims may be ascertainable by 
reference to the description. 



3. Claims 17 and 18 are objected to under 37 CFR §1.75(a) and (d)(1) as failing to 
particularly point out and distinctly claim the subject matter that the applicant regards as the 
invention. 
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Regarding claims 17 and 18, there is insufficient antecedent basis for "the three- 
dimensional model." Correction is required. 

Claim Rejections - 35 USC §103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

5. Claims 1-3, 5-11, and 19 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
U.S. Patent 6,721,449 by Krishnamachari in view of "Image Retrieval with Local and Spatial 
Queries" by Moghaddam et al. ("Moghaddam"). 

Regarding claims 1 and 19, Krishnamachari discloses a method of measuring color 
consistency comprising: 

obtaining a first 2-D image and a second 2-D image of an object (figure 1: a target image 
and a reference image of an objectfrom a database are obtained); 

subdividing the first image into a first set of partitions and the second image into a second 
set of image partitions, each partition having a color (i.e. each of the first and second images are 
partitioned into pixels ("partitions"), each pixel having a color); 

selecting a first subset of image partitions in the first set of image partitions (e.g. a first 
image block as one of 4x4, 8x8, or 16x16 image blocks is a first subset of pixels in the target 
image) and a second subset of image partitions in the second set of image partitions (e.g. a 
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second image block as one of 4x4, 8x8, or 16x16 image blocks is a second subset of pixels in the 
reference image) (see column 4, line 59 through column 5, line 13); 

assigning each image partition in the first subset and each image partition in the second 
subset a color value corresponding to the color of the image partition (column 4, lines 33-58: 
pixels in each block are assigned CIELAB or CIELUV color values based on their respective 
colors); 

placing each image partition in the first subset in one of a first series of histogram 
subdivisions and each image partition in the second subset in one of a second series of histogram 
subdivisions based on the color value of each image partition (column 5, lines 14-34: for each of 
the first and second image blocks, an histogram is generated whereby pixels in each block are 
accumulated into histogram subdivisions based on color values of the pixels); 

comparing the first series of histogram subdivisions to the second series of histogram 
subdivisions (column 5, lines 25-34: the histograms of corresponding image blocks in the target 
and reference images are compared based on the "proportion of occurrences" of the colors 
therein, thereby effecting a comparison of the histogram bins ("subdivisions") for corresponding 
blocks in each of the two images); 

processing the second image based on whether the first series of histogram subdivisions 
and the second series of histogram subdivisions have a similarity (column 6, lines 19-29: if the 
first and second series of histograms subdivisions are similar (as well as other corresponding 
series pairs), then the reference image is identified as being similar to the target image, and is 
processed so that it is displayed in a list of similar images). 
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Krishnamachari is silent to selecting the blocks ("subsets") of pixels ("image partitions") 
"based upon criteria related to a 3-D region of the object" and processing "the region" based on 
whether the pair of series of histogram subdivisions is similar. 

Moghaddam discloses a content-based image retrieval system, similar to that of 
Krishnamachari, in which database images that are substantially similar to a target image are 
retrieved. Moghaddam, like Krishnamachari, utilizes local color histograms in order to effect a 
comparison between a target and a reference image. 

Moghaddam also discloses the feature of allowing a user to specify regions of interest 
which serve as search criteria and lead to "a more powerful search engine." See § 1 . As shown in 
figure 1, a user can select region(s) of interest corresponding to three-dimensional objects in a 
scene. Those regions of interest are then processed using local histogram measures, as shown in 
figure 2. The histograms of those regions are then matched to histograms of the reference images 
in order to find a sufficiently matching image. 

It would have been obvious to one of ordinary skill in the art at the time of the invention 
to modify Krishnamachari by Moghaddam to select the subsets of image partitions "based upon 
criteria related to a 3-D region of the object" and process "the region" based on whether the pair 
of series of histogram subdivisions is similar since Moghaddam discloses that selecting subsets 
of image partitions in a target image based on a region of a 3-D object according to a user's 
preference and then processing (e.g. retrieving and displaying) the region based on the similarity 
between histogram subdivisions of the target and reference images produces "a more powerful 
search engine"; a user is allowed to specify arbitrary regions of objects to be retrieved rather than 
relying on a computer to specify the regions (see Abstract and § 1). 
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Regarding claim 2, Krishnamachari discloses that the obtaining step comprises obtaining 
images of a scene as the object (figure 1: "target image" and reference image(s) in the "image 
database" are images of scenes). 

Regarding claim 3, Krishnamachari discloses subdividing the first and second image into 
pixels (i.e. the images are digital images, which are divided into pixels). 

Regarding claim 5, Moghaddam discloses that only the pixels located in the region are 
selected (see figure 2(b)). 

Regarding claim 6, Krishnamachari discloses assigning an array value as the color value 
(column 4, lines 33-59: e.g. LUV array value). 

Regarding claim 7, Krishnamachari discloses assigning a 3-D array value (i.e. LUV is a 
3-D array). 

Regarding claim 8, Krishnamachari discloses that utilizing R, G, and B values is 
conventional (column 1, lines 35-45). 

Regarding claim 9, Krishnamachari discloses that the RGB values are typically 24 bits, 
so that the values of each color range from 0-255 (column 1, lines 35-45). 

Regarding claim 10, Krishnamachari discloses combining the R, G, and B values into a 
smaller number of agglomerate values (column 1, lines 55-64). 

Regarding claim 11, Krishnamachari discloses that combining portions of the first and 
second histogram subdivisions into a first and second series of histogram partitions is 
conventional (column 1, lines 47-67: the 24-bit RGB values, representing millions of colors, are 
quantized into 64 colors so that the millions of histogram subdivisions for each image are 
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combined to form 64 partitions -> in other words, portions of the first and second histogram 
subdivisions (i.e. different groups of the histogram bins) are combined into a series of histogram 
partitions (i.e. the groups each combine to from one of 64 partitions)). 



6. Claim 4 is rejected under 35 U.S.C. 103(a) as being unpatentable over Krishnamachari in 
view of Moghaddam, and further in view of U.S. Patent 4,985,856 by Kaufman et al. 
("Kaufman"). 

Regarding claim 4, Krishnamachari and Moghaddam are silent to selecting the subset 
based on criteria related to a voxel region of the object. 

Kaufman discloses a 3-D image storage and retrieval system. Rather than storing 
conventional 2-D image data, Kaufman's system is operative to store and retrieve 3-D image 
data composed of voxels. 

It would have been obvious to one of ordinary skill in the art at the time of the invention 
to modify Krishnamachari and Moghaddam by Kaufman to select a the subsets based on criteria 
related to a voxel region, rather than criteria related to a pixel region, since Kaufman discloses 
that it is desirable to represent images in 3-D with voxels and store and retrieve such images (see 
column 2, lines 56-66 and column 9, lines 45-52). 

7. Claim 15 is rejected under 35 U.S.C. 103(a) as being unpatentable over Krishnamachari 
in view of Moghaddam, and further in view of U.S. Patent 6,691,126 by Syeda-Mahmood. 
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Regarding claim 15, Krishnamachari and Moghaddam are silent to the object including a 
Lamertian surface. 

Syeda-Mahmood discloses an image processing system for locating objects in a video 
database. In particular, Sydea-Mahmood discloses methods by which Lambertian surfaces are 
modeled and retrieved in a video database (see column 6, lines 41-48). 

It would have been obvious to one of ordinary skill in the art at the time of the invention 
to modify Krishnamachari and Moghaddam by Syeda-Mahmood to choose the object to include 
a Lambertian surface, since Krishnamachari and Moghaddam disclose that any arbitrary object in 
an image may be obtained for retrieval purposes, and Syeda-Mahmood shows that it is 
conventional to retrieve objects that represent Lamertian surfaces. 

8. Claim 14 is rejected under 35 U.S.C. 103(a) as being unpatentable over Krishnamachari 
in view of Moghaddam, and further in view of "Color Indexing" by Swain et al. ("Swain"). 

Regarding claim 14, Krishnamachari is silent to comparing corresponding histogram 
subdivisions, as claimed. 

Swain discloses the conventional manner in which histograms are compared. At § 3.1.1, 
Swain discloses that histograms are compared by comparing corresponding histogram 
subdivisions via a "min" function to see if each subdivision contains at least one pixel. 

It would have been obvious to one of ordinary skill in the art at the time of the invention 
to modify Krishnamachari and Moghaddam by Swain to compare histograms as claimed, since 
Swain shows that comparing corresponding histogram subdivisions to ascertain whether pixels 
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are present in each of the bins is a conventional technique for effecting a comparison of 
histograms. 

9. Claim 17 is rejected under 35 U.S.C. 103(a) as being unpatentable over Krishnamachari 
in view of Moghaddam, and further in view of U.S. Patent 6,711,288 by Kim et al ("Kim"). 

Regarding claim 17, neither Krishnamachari nor Moghaddam discloses assigning a 
uniform region color to the entire region in the object. 

Kim discloses a method for designating a local representative color value for image 
regions in order to facilitate image retrieval. In particular, Kim discloses assigning uniform 
region colors to each of the image regions based on the local color histogram (see figure 2 A, 
block S52). Then, the local representative color of each region is used to select an optimal 
searching algorithm. 

It would have been obvious to one of ordinary skill in the art at the time of the invention 
to modify Krishnamachari and Moghaddam by Kim to assign the region a uniform color since 
Kim discloses that utilizing local representative colors (i.e. uniform region colors) allows an 
optimal search algorithm to be automatically ascertained (see column 3, lines 18-25). 

Allowable Subject Matter 

10. Claims 12, 13, 16, 18, and 20 are objected to as being dependent upon a rejected base 
claim, but would be allowable if rewritten in independent form including all of the limitations of 
the base claim and any intervening claims. 
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Regarding claim 12, Krishnamachari does not disclose or suggest that either of the first or 
second series of histogram partitions partially overlap. Rather, Krishnamachari suggests that the 
64 histogram partitions would necessarily be non-overlapping. See also the explanation for claim 
11. 

Regarding claims 16 and 20, Krishnamachari discloses the obtaining, subdividing, 
selecting, assigning, placing steps, as pertaining to a second reference image in the image 
database. Krishnamachari also discloses comparing the third series of histogram subdivisions of 
the second reference image to the first series of the target image. However, Krishnamachari does 
not disclose comparing the third series of histogram subdivision of the second reference image to 
the second series of histogram subdivisions of the first reference image. In Krishnamachari's 
system, characteristics of the reference images are not compared to each other; they are each 
exclusively compared to the target image. 

Regarding claim 18, neither Krishnamachari nor Moghaddam disclose or suggest 
deciding whether to use the region based on the number of partitions, as claimed. 

Conclusion 

1 1 . The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

U.S. Patent 6,363,170 by Seitz et al discloses voxel coloring 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Colin M. LaRose whose telephone number is (703) 306-3489. If 
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attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, Amelia 
Au, can be reached on (703) 308-6604. The fax phone number for the organization where this 
application or proceeding is assigned is (703) 872-9306. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the TC 2600 Customer Service Office whose telephone number is (703) 



306-0377. 
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